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REDUCING SPARKLE ARTIFACTS WITH LOW BRIGHTNESS FILTERING 
Background of the Invention 

1 . Field of the Invention 

This invention relates to the field of video systems 
5 utilizing a liquid crystal display (LCD) , and in particular, 
to video systems utilizing normally white liquid crystal on 
silicon imagers. 

2 . Description of Related Art 

Liquid crystal on silicon (LCOS) can be thought of as one 

10 large liquid crystal formed on a silicon wafer. The silicon 
wafer is divided into an incremental array of tiny plate 
electrodes. A tiny incremental region of the liquid crystal 
is influenced by the electric field generated by each tiny 
plate and the common plate. Each such tiny plate and 

15 corresponding liquid crystal region are together referred to 
as a cell of the imager. Each cell corresponds to an 
individually controllable pixel. A common plate electrode is 
disposed on the other side of the liquid crystal. Each cell, 
or pixel, remains lighted with the same intensity until the 

20 input signal is changed, thus acting as a sample and hold. 

The pixel does not decay, as is the case with the phosphors in 
a cathode ray tube. Each set of common and variable plate 
electrodes forms an imager. One imager is provided for each 
color, in this case, one imager each for red, green and blue. 

25 It is typical to drive the imager of an LCOS display with 

a frame-doubled signal to avoid 3 0 Hz flicker, by sending 
first a normal frame (positive picture) and then an inverted 
frame (negative picture) in response to a given input picture. 
The generation of positive and negative pictures ensures that 

30 each pixel will be written with a positive electric field 

followed by a negative electric field. The resulting drive 
field has a zero DC component, which is necessary to avoid the 
image sticking, and ultimately, permanent degradation of the 
imager. It has been determined that the human eye responds to 
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the average value of the brightness of the pixels produced by 
these positive and negative pictures. 

The drive voltages are supplied to plate electrodes on 
each side of the LCOS array. In the presently preferred LCOS 
5 system to which the inventive arrangements pertain, the common 
plate is always at a potential of about 8 volts. This voltage 
can be adjustable. Each of the other plates in the array of 
tiny plates is operated in two voltage ranges. For positive 
pictures, the voltage varies between 0 volts and 8 volts. For 
10 negative pictures the voltage varies between 8 volts and 16 
volts . 

The light supplied to the imager, and therefore supplied 
to each cell of the imager, is field polarized. Each liquid 
crystal cell rotates the polarization of the input light 

15 responsive to the root mean square (RMS) value of the electric 
field applied to the cell by the plate electrodes. Generally 
speaking, the cells are not responsive to the polarity 
(positive or negative) of the applied electric field. Rather, 
the brightness of each pixel's cell is generally only a 

20 function of the rotation of the polarization of the light 

incident on the cell. As a practical matter, however, it has 
been found that the brightness can vary somewhat between the 
positive and negative field polarities for the same 
polarization rotation of the light. Such variation of the 

25 brightness can cause an undesirable flicker in the displayed 
picture . 

In this embodiment, in the case of either positive or 
negative pictures, as the field driving the cells approaches a 
zero electric field strength, corresponding to 8 volts, the 
3 0 closer each cell comes to white, corresponding to a full on 

condition. Other systems are possible, for example where the 
common voltage is set to 0 volts. It will be appreciated that 
the inventive arrangements taught herein are applicable to all 
such positive and negative field LCOS imager driving systems . 
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Pictures are defined as positive pictures when the 
variable voltage applied to the tiny plate electrodes is less 
than the voltage applied to the common plate electrode, 
because the higher the tiny plate electrode voltage, the 
5 brighter the pixels. Conversely, pictures are defined as 
negative pictures when the variable voltage applied to the 
tiny plate electrodes is greater than the voltage applied to 
the common plate electrode, because the higher the tiny plate 
electrode voltage, the darker the pixels. The designations of 
10 pictures as positive or negative should not be confused with 
terms used to distinguish field types in interlaced video 
formats * 

The present state of the art in LCOS requires the 
adjustment of the common-mode electrode voltage, denoted Vito, 
15 to be precisely between the positive and negative field drive 
for the LCOS. The subscript ITO refers to the material indium 
tin oxide. The average balance is necessary in order to 
minimize flicker, as well as to prevent a phenomenon known as 
image sticking, 

20 A light engine having an LCOS imager has a severe non- 

linearity in the display transfer function, which can be 
corrected by a digital lookup table, referred to as a gamma 
table. The gamma table corrects for the differences in gain 
in the transfer function. Notwithstanding this correction, 

25 the strong non-linearity of the LCOS imaging transfer function 
for a normally white LCOS imager means that dark areas have a 
very low light-versus-voltage gain. Thus, at lower brightness 
levels, adjacent pixels that are only moderately different in 
brightness need to be driven by very different voltage levels. 

3 0 This produces a fringing electrical field having a component 
orthogonal to the desired field. This orthogonal field 
produces a brighter than desired pixel, which in turn can 
produce undesired bright edges on objects. The presence of 
such orthogonal fields is denoted declination. The image 
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artifact caused by declination and perceived by the viewer is 
denoted sparkle. The areas of the picture in which 
declination occurs appear to have sparkles of light over the 
underlying image. In effect, dark pixels affected by 
5 declination are too bright, often five times as bright as they 
should be. Sparkle comes in red, green and blue colors, for 
each color produced by the imagers. However, the green 
sparkle is the most evident when the problem occurs. 
Accordingly, the image artifact caused by declination is also 

10 referred to as the green sparkle problem. 

LCOS imaging is a new technology and green sparkle caused 
by declination is a new kind of problem. Various proposed 
solutions proposed by others include signal processing the 
entire luminance component of the picture, and in so doing, 

15 degrade the quality of the entire picture. The trade-off for 
reducing declination and the resulting sparkle is a picture 
with virtually no horizontal sharpness at all. Picture detail 
and sharpness simply cannot be sacrificed in that fashion. 

One skilled in the art would expect the sparkle artifact 

20 problem attributed to declination to be addressed and 
ultimately solved in the imager as that is where the 
declination occurs. However, in an emerging technology such 
as LCOS, there simply isn't an opportunity for parties other 
than the manufacturer of the LCOS imagers to fix the problem 

25 in the imagers. Moreover, there is no indication that an 

imager-based solution would be applicable to all LCOS imagers. 
Accordingly, there is an urgent need to provide a solution to 
this problem that can be implemented without modifying the 
LCOS imagers . 
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Brief Summary of the Invention 
The inventive arrangements taught herein solve the 
problem of sparkle in liquid crystal imagers attributed to 
declination without degrading the high definition sharpness of 
the resulting display. Moreover, and absent an opportunity to 
address the problem by modification of liquid crystal imagers, 
the inventive arrangements advantageously solve the sparkle 
problem by modifying a video signal to be displayed, thus 
advantageously presenting a solution that can be applied to 
all imagers, including LCOS imagers. The video signal can be, 
for example, an input luminance signal or a video drive 
signal. Any reduction in detail is advantageously and 
adjustably limited to dark scenes, even very dark scenes. The 
video signal is signal processed in such a way that higher 
brightness level information is advantageously unchanged, thus 
retaining high definition detail. At the same time, the lower 
brightness levels of the video signal that directly result in 
sparkle are processed or filtered in such a way that the 
sparkle is advantageously prevented altogether, or at least, 
is reduced to a level that cannot be perceived by a viewer. 
The signal processing or filtering of the lower brightness 
level information advantageously does not adversely affect the 
detail of the high definition display. Moreover, the signal 
processing or filtering advantageously can be adjusted or 
calibrated in accordance with the non-linearity of any gamma 
table, and thus, can be used with and adjustably fine tuned 
for different LCOS imagers in different video systems. 

In a presently preferred embodiment, the video signal of 
a picture is decomposed into a higher brightness level signal 
and a lower brightness level signal. The demarcation between 
higher and lower brightness levels is adjustable and 
preferably related to the transition between the lower and 
higher gain portions of the gamma table. The lower brightness 
level signal is low pass filtered to reduce the difference in 
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brightness levels between adjacent pixels. The higher 
brightness level signal is delayed in time to match the 
processing delay through the low pass filter. The delay 
matched higher brightness level signal and the low pass 
5 filtered lower brightness level signal are then combined to 
form a modified video signal. 

In a video display system the luminance signal can be 
modified and supplied to a color space converter, also 
referred to as a matrix, together with the R-Y and B-Y 

10 chrominance signals. The chrominance signals are also delayed 
to match the delay through the sparkle reduction circuit. 
Sparkle reduction processing of the luminance signal has been 
found to reduce the sparkle problem by about 60% to 70%. 

The outputs of the color space converter are video drive 

15 signals, for example, RGB, supplied to the LCOS imager. In 
another embodiment, one or two or all of the video drive 
signals are also subjected to the same sparkle reduction 
processing as is the luminance signal. Video drive signals 
that are not sparkle reduced must be delay matched. The 

20 modified video drive signals are then supplied to the liquid 
crystal imager. When all of the video drive signals are 
further processed, the sparkle problem has been found to be 
reduced by about 85% to 90%. Each decomposer advantageously 
has an independently selectable brightness level threshold. 

25 In yet another embodiment, the luminance signal is not 

sparkle reduced, but one or two or all of the video drive 
signals are processed for sparkle reduction. Video drive 
signals that are not sparkle reduced must be delay matched. 
In each embodiment, the sparkle reduction processing 

3 0 changes the brightness levels of the pixels in the lowest 

brightness levels, corresponding to the highest gain portion 
of the gamma table, in such a way as to reduce the occurrence 
of declination in the imager. A threshold for the luminance 
signal decomposer, for example, can be expressed as a digital 
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fraction, for example a digital value of 60 out of a range of 
255 digital steps (60/255), as would be present in an 8-bit 
signal. The threshold can also be expressed in IRE, which 
ranges from 0 to 10 0 in value, 10 0 IRE representing maximum 
5 brightness . The IRE level can be calculated by multiplying 
the digital fraction by 100. The IRE scale is a convenient 
way to normalize and compare brightness levels between signals 
having different numbers of bits. The value of 60, for 
example, corresponds approximately to 2 4 IRE. In a presently 
10 preferred embodiment, the threshold value for the luminance 
decomposer is 8, corresponding to approximately 3.1 IRE. 
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Brief Description of the Drawings 
Figure 1 is a block diagram of a sparkle reducing circuit 
in accordance with the inventive arrangements. 

Figure 2 is a block diagram useful for explaining the 
5 operation of a decomposer in Figure 1. 

Figure 3 is a block diagram useful for explaining the 
operation of a delay matching circuit and a low pass filter in 
Figure 1 . 

Figure 4 is a block diagram of a portion of a video 
10 display system incorporating different combinations of sparkle 
reducing circuits. 

Figures 5 (a) -5(e) are waveforms useful for explaining the 
operation of the sparkle reducing circuit. 
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Detailed description of the Preferred Embodiments 
A circuit for reducing sparkle artifacts attributed to 
declination errors in liquid crystal video systems, for 
example LCOS video systems, is shown in Figure 1 and generally 
5 denoted by reference numeral 10_. The circuit comprises a 

decomposer 12, a low pass filter 22, a delay match circuit 24 
and an algebraic unit 26. An input video signal X, for 
example a luminance signal or a video drive signal, is 
modified by the circuit 10, and in response, an output video 

10 signal X' is generated. The video signal is a digital signal, 
and the waveform is a succession of digital samples 
representing brightness levels. The output signal X' has a 
similar digital format. The decomposer 12 generates a higher 
brightness level signal 2 0 and a lower brightness level signal 

15 18. The operation of decomposer 12 is illustrated in Figure 
2 . 

With reference to Figure 2, a block 14 has a first set of 
rules for generating the higher brightness level signal. The 
input signal X represents a succession of brightness level 

20 samples defining a luminance input signal. The brightness 

level of each sample can be expressed numerically as a digital 
value or an IRE level, for example 60/255 or 24 IRE, as 
explained above. The letter T represents a threshold value, 
which can also be expressed as a digital value or an IRE 

25 level. If X is greater than T, then the brightness level H of 
the higher brightness level signal is equal to X minus T. If 
X is less than T, then the brightness level H of the higher 
brightness level signal is equal to 0. 

A block 16 has a second set of rules for generating the 

30 lower brightness level signal. If X is greater than T, then 

the brightness level L of the lower brightness level signal is 
equal to the threshold T. If X is less than T, then the 
brightness level L of the lower brightness level signal is 
equal to X. 
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It may be noted that when X = T, the output of block 14 
will be the same whether X is defined as less than or equal to 
T, or X is defined as greater than or equal to T. In each 
case, H is equal to 0 . It may also be noted that when X = T, 
5 the output of block 16 will be the same whether X is defined 
as less than or equal to T, or X is defined as greater than or 
equal to T. In each case, L is equal to X. 

Referring again to Figure 1, the lower brightness level 
signal 18 is an input to the low pass filter 22. The higher 
10 brightness level signal 20 is an input to the delay match 
fS * circuit 24. The details of the low pass filter 22 and the 
w delay match circuit 24 are shown in Figure 3. Low pass filter 
p 22 is embodied as a normalized 1:2:1 Z-transform. The low 
*t pass filtering incurs a one clock period delay, and 

CO 15 accordingly, the delay match circuit 24 provides a one clock 

period delay for the higher brightness level signal. The low 
O pass filtered lower brightness level signal, denoted LOWf, and 
□ the delayed higher brightness level signal denoted HIGHd are 
combined in an algebraic unit 26, which generates the output 
^20 signal X' . 

A video system 3_0 shown in Figure 4 illustrates various 
combinations in which video signals, for example luminance 
signals and video drive signals, can be processed for sparkle 
reduction. A color space converter, or matrix, 3 2 generates 
25 video drive signals, for example RGB, responsive to a 

luminance signal, denoted LUMA, and chrominance signals, 
denoted CHROMA. The chrominance signals are more particularly 
designated R-Y and B-Y. 

Two sets of inputs to the color space converter 3 2 are 
30 denoted 34A and 34B. In set 34A the LUMA signal input is 

modified by sparkle reduction processor (SRP) 10 to generate 
LUMA ' . The CHROMA signals are delayed by delay match (DM) 
circuits 36. In set 34B the LUMA signal is not modified and 
the CHROMA signals are not delay matched. 
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Four sets of outputs from the color space converter 32 
are denoted 40A, 40B, 40C and 40D. In set 40A the video drive 
signals RGB are not modified. In set 4 OB, each one of the RGB 
video drive signals is modified by a sparkle reduction 
5 processor 10. No delay matching is necessary. In set 40C 
only one of the video drive signals, for example G, is 
modified by sparkle reduction processor 10 to generate G' . 
The remaining video drive signals are delayed by delay 
matching circuits 36. In set 40D only two of the video drive 

10 signals, for example R and G, are modified by sparkle 

reduction processors 10 to generate R' and G' . The remaining 
video drive signal is delayed by delay matching circuit 36. 
Input set 34A can be used with any one of output sets 4 OA, 
40B, 40C or 40D. Input set 34B can be used with any one of 

15 output sets 40B, 40C or 40D. The combination of input set 34B 
and output set 4 OA does not include sparkle reduction 
processing . 

It has been found that using the combination of input set 
3 4A and output set 4 OA reduces the sparkle artifact attributed 

20 to declination by about 60% to 70%. It has also been found 

that using the combination of input set 34A and output set 4 0B 
reduces the sparkle artifact attributed to declination by 
about 85% to 90%. This substantial reduction advantageously 
solves the sparkle problem for all practical purposes. It 

25 should be appreciated that although the sparkle reduction 
processing circuits in Figure 4 can be identical to one 
another, the threshold value for each of these sparkle 
reduction processors can advantageously be independently 
selected. This enables the sparkle reduction processing to be 

30 fine tuned to the different video signals. 

The response of circuit 10 in Figure 1 to a specific 
input signal is illustrated in Figures 5(a) through 5(e). For 
purposes of illustration, the threshold T is set to the 
digital value or state of 8, corresponding to approximately 
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3.1 IRE for an 8-bit signal. The waveforms of Figures 
5 ( a ) -5(e) are aligned in time to demonstrate the delay 
incurred by the low pass filtering and the delay match 
circuit. The first samples in each of Figures 5(a) and 5(c) 
are aligned with one another. The first samples of Figures 
5(b), 5(d) and 5(f) are aligned with one another. 

In Figure 5(a) an input signal X has the luminance values 
shown by the black dots. Each black dot represents a sample 
of a luminance value as an input to the decomposer 12 . Each 
sample represents the brightness level of a pixel. The signal 
X can be seen as including a pulse followed by an impulse. 
The threshold value of T, as explained in connection with the 
rules of Figure 2, is equal to 8 in this example. 

The first two values of X are 0. In accordance with 
block 14, the value of the delay matched higher brightness 
level signal HIGHd shown in Figure 5(b) is 0 because X is less 
than T. The next three input values are 20. The 
corresponding levels of the higher brightness level signal in 
Figure 5 (b) are 12 because the output value equals the input 
value minus the threshold value (X-T) . The remaining sample 
values are calculated in the same fashion. 

With reference to Figure 5(c), the first two output 
values of the lower brightness level signal LOW are 0, because 
the input is less than the threshold and the output equals the 
input. The next three output values are equal to 8 because 
the input value is greater than that threshold, and in this 
case, the output equals the threshold value. The remaining 
samples are calculated in the same fashion. 

Figure 5 (d) represents the output LOWf of low pass filter 
22 responsive to the signal shown in Figure 5(c). The values 
are shown as indicated, and it can be noted that the pulse and 
impulse which are still evident in the wave form of Figure 
5(c) have been considerably smoothed, or rolled off, by the 
low pass filtering. 
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Finally, Figure 5(e) is the output signal X', which is 
the sum of the wave forms in Figures 5(b) and 5(d) . It can be 
noted from the wave form in Figure 5(e) that the essential 
character of the pulse and of the impulse in the input wave 
form X been retained in the output wave form X, but sharp 
edges or transitions between adjacent sample values have been 
advantageously reduced. Only the very dark areas of the 
picture are noticeably affected by the sparkle reduction 
processing, as evidenced by the very low value of the 
threshold limit. Accordingly, the high definition horizontal 
resolution is advantageously maintained. 

The methods and apparatus illustrated herein teach how 
the brightness levels of adjacent pixels can be restricted or 
limited in the horizontal direction, and indeed, these methods 
and apparatus solve the sparkle problem. Nevertheless, these 
methods and apparatus can also be extended to restricting or 
limiting brightness levels of adjacent pixels in the vertical 
direction, or in both the horizontal and vertical directions. 
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